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I (54) Title: ELECTRONIC STEREOSCOPIC MEDL\ DELIVERY SYSTEM 




^ (57) Abstract: The preferred embodiment addresses the problenri of deliveringsteiwscopic media in electronic fonn(iinag 

animations, object models, etc.). First, il provides a single format with independent right and left channels to repiesent the stereo- 

2 scopic media. Second, it provides a means of displaying stereoscopic media inside a movable windowed area while eliminating 
pseudostereo conditions during movement Third, it provides automatic and manual optimization adjustments (parallax shift adjust- 

Q ment, brightness control, color adjustment, and cross-talk reduction) to the stereoscopic media based on viewing hardware, monitor 
size, and media content for optimal viewit^ quality. Fourth, it provides seamless support for monoscopic (2D) viewing modes al- 
lowing delivery of said stereoscopic media in a normal 2D viewing mode. 
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ELECTRONIC STEEIEOSCOHC MEDIA" DEETVERY SYSTEM 
TECHNICAL FIELD 

The invention is directed to providing a means of delivering stereoscopic media on and off the 
Internet. In particular the invention provides a means of encoding stereoscopic media, transmitting and 
5 storing stBieoscopic media, displaying steiec^copic media, and providing helpfid tools for viewing the 
meidia. 

B ACKGROX3ND OF THE INVENnON 

St^eoscopic innages have been in use for hundreds of yeats. Recently stereoscopic images, and 
other fonns of stereoscopic media like aoimations and video, have been converted to dectcooic fona 

10 for display on prasonal computers, the Internet, and on other electronic media like CD-ROMs. 
Stereoscopic media has been successfully used in numerous appHcatioins ranging Itom medical 
imaging, to entealainmcat, to training, to decttonic cammetoe. 

Stereoscopic media and viewing systems can talse on numeious foixnats^ For example, there are 
several ways to encode a still stereoscopic 3D imagp including red/blue anaglyphic fonnat, side-by- 

15 side, interleaved or line-alternate formats, etc. There are also numerous viewing systems available to 
viewing steaceoscopic media: red/blue glasses, active shutter glasses, hi^-speed page-flif^ng graphics 
cards with shutter g^ses, line-blanking viewing systems, crc^s^ye lens systems, etc. Many of these 
media and viewing formats are not compatible witii each other. The fact that the stea^eoscopic media 
for these various systems is not compa^le makes it difficult for a content devdoper, sucb as a CD- 

20 ROM developer, (x Website devdopei, to support aU of tiie stereoscopic viewing devices on the 
market 

Several patents contain background information for this disclosure. They include: US Patent 
6,028,649 dated 02/22/2000 and entitled *'Image Display Systems having Direct and Projection 

1 
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Viewing Modes"; US PatBnt-6,016,159 dated 01/18/2000 and entitled "N4ethod ana~Apparatus for 
Producing and Displaying Spectially-midtiplexed Images of Thiee-dimensional Imagery far Use in 
Stereoscopic Viewing Theieor; US Patent 6,002^18 dated 12/14/1999 and entitled "Fhase-retardation 
Based System for Stereoscopic Viewing IVficropolarized Spatially-multiplexed Images Substantially 

5 Etee of \lsual-channd Qos&-taIk and Asymmetric Imagp Distortion"; US Patent 5,844,717 dated 
12/01/1998 and entifled "Method and System for Producing Micropoiarization panels for Use in 
Micropolarizing Spatially Multiplexed linages of 3-D Objects During StMeoscopic Display Processes"; 
US Patent 5,828,427 dated 10/27/1998 and entifled "Computear-based Image Display Systems Having 
Direct and Projection Modes of Viewing"; US Patent 5,760,827 dated 06/02/1998 and entitled "Pixel- 

10 data Processing System and Method for Producing Spectrally-multipiexed Images of Three- 
dimensional Imagciy fcff Use in Steteoscopic Viewing Hiereof'; US Patent 5,745,164 dated 
04/28/1998 entitled System and Method for Electro-optically Producing and Displaying Spectrally- 
multiplexed Images of Three-dimensional Imagery for Use in Steteoscopic Viewing ThereoT; US 
Patent 5,7423,33 dated 04/21/1998 and entitled "Hectto-optical Device for Selectively Transmitting 

15 Polarized Spectral Components"; US Patent 5,680,233 dated 10/21/1997 and entitled loaage Display 
Systesms Having Direct and Projection "Shewing Modes"; US Patent 5,553,203 dated 09/03/1996 and 
entitled "Pixd Data Processing System and Mdfaod for Producing and Graphically Presenting Spatially 
Multiplexed Images of 3-D Objects for StereosC(^c Viewing Thereof; US Patent 6,031,564 dated 
02/29/2000 and entifled "Method and Apparatus for Monoscopic to Stereoscopic Image Conversion"; 

20 US Patent 6,011,581 dated 01/04/2000 and imtitlBd 'InteUigent Method and System for Piodocmg and 
Ksplaymg Steraoscopically-mnltiplexed Images of Three-dimensional Objects for Use in Realistic 
Stereoscopic Viewing Theareof In Interactive Virtual Reality Display Environments"; and US Patent 
5,537,144 dated 07/16/1996 and entifled "Electro-optical Display System for Visually Displaying 

2 
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Polarized Spatially Multiplexed Images of 3-D Objsits for Use in SteDBoscoiHcally Viewing Hie Same 
"V^th High Image Quality and Resolution. 

In order to facilitate the growth of stereoscopic 3D media in electronic form, an easy to use, 
multi-fonnat delivery system is needed. This invention presents new stereoscopic media delivery 
5 system fliat includes means for ^coding steieoscopic media, transmitting and storing stereoscopic 
media, displaying steieoscopic media, and providing helpj&d tools for viewing the media. 
SUMMARY OF THE INVENTION 

The prefeired embodiment addresses the problem of deEveting stoeoscopic media in electronic 
form (images, vitteos, animations, object models, etc.). Firstly, it provides a singile fiomiat with 
10. independent right and left channels (with an option for mixed or oambined right and left channels) to 
represent the straeoseopic media. Secondly, it provides a means of displaying stereoscopic media 
inside a movable windowed area while eliminating pseudosteieo ccHiditions during movement. 
Hiirdly, it provides automatic and manual optimization adjustments such as parallax shift adjustment, 
brightness contrpli color adjustment, and cross-tallc reducticm to the stereoscopic media based on 
15 viewing hardware, monitor size, and media content for optimal viewing quality. Fourthly, it provides 
seamless support for monoscopic (2D) viewing modes allowing delivery of said stereoscopic media in 
a normal 2D viewing mode. 

These and other features of the present invention will be apparent from the following 
description of the drawings, detaUed description, and appended claims and drawmgs. 
. 20 BRIEF DESCRIPTION OF THE DRAWINGS 

Figuce 1 illustrates the various display fonnats emi)odied in the invention; 

Hgure 2 illustrates the contents of a window displayed in steieo; 
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Egure-3-iflu^xates the contents of a window displayed in revBrse sHreo; 
Figure 4 illustrates the contents of a scrolling window displayed in steieo; 
Figure 5 illustrates a genera! software flowchart; 

Figure 6 illustrates the scaling of stososcopic 3D media while jseserving the left and ligjit 

media; 

Hguie 7 illustrates the scaling of stoeosoopic 3D media without preserving the left and right 

media; 

Figure 8 illustrates the automatic bri^tness adjustment of a stereoscopic 3D media file; 
Hguie 9 illustxates tiie setting of script commands to a preselected display mode; 
Hgore 10 illustrates the contents of a VKR file; 
Rgure 1 1 illustrates a paftdlel viewing mode; 
Figure 12 illustrates a cross-eye viewing mode; 

Hgure 13 illustrates the ability to download larger sized 3D stereoscopic content Sles as a 
background task or during idle use times of the wodsBtation; . 
Figure 14 illustrates the side by side format; 

Figure 15 illustrates one metiiod of displaying helper alignment images for a cross eye viewing 

mode; 

Figure 16 illustrates one way to stosre a series of N images into a single resource file; 
Hgure 17 illustrates the relationship between the images and the object in question; 
Rgure 18 illustrates an embodiment that allows a larger 3D stereoscopic image or panorama to 
be scrolled within a smaller viewing window; 

Figure 19 illustrates an cffiginal right and left camera view of an object 
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DETAILED DESCRIFnON OF IBElNVENTrON 

The ecabodiments of the inv^tion include display mediods, encoding methods and tootls. 
With regard to display methods this includes a single media file format that is converted to various 
display fonoats on the usor side; stereoscopic media in a window such as a browser or application; 

5 stereoscopic pr^ervation in a window during scioUing and window movement; support of auto- 
detection 3D stereo haidwate systems; script buttons (VSR scripts) to change global stereo formats; 
stereo media file formats that contain sub media such as VRR and blocks; parallax shift adjustments 
based on physical size of display window; automatic hri^tness adjustments; color 
calibrotioii/adjustments for physical 3D viewing mechanisms, including variations in display devices; 

10 crosstalk reductian techmques on user side; smart stereo scaling; inte^^on of stereo media types into 
one viewer with script intaaction; monoscopic and stereoscopic viewing that allows greater 
distribution since both types can be viewed within one system; save and conversion of one format into 
another from the Internfit using a local drive from the original source; automatic ftee view image size 
adjustment to minimize viewing fatigue; pseodostereo conection based on image processing of a few 

15 lines or the entire image; scaling stereo media, so that the teft and ri^t sources are preserved; and 
improvements to Anaglyph display methods. Since the format of the original left and rig^t is known, 
as designated by the tag within the Stereoscopic 3D Media file, the scaling can be done while 
preserving steieo. Additionally, looking at the storage method used, it is necessary to take the 
apprc^ate actions to scale the media while preserviitig the stereo and to perform scaling done to 

20 increase or decrease the display size of the stereoscopic media. 

In existing systems, stereo media can only be viewed at the original size. The embodiment of 
Kgure 1 provides a mechanism to increase or decrease the size at which the media is displayed while 
preserving the stereo. As shown in Hgure 1 with analysis 10, the left and ri^ media are extracted 
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from-ttie Stereoscopic 3D Media file 12, scaled, lecombined into" the selected display method, then the 
resulting scaled Stereoscopic Media is displayed. The displayed fonnats include Monoscopic 14, line- 
Interleaved, Cross-eye 18, Parallel 20, Various Anaglyph 22 Page-flipping 24 and Others 26. 

Another embodinaent of the present invention is to provide a system to access 3D stereoscopic 
5 content through the internet or an intranet or similar network enyiranment where the 3D stereoscopic 
content is stored in a location that is not physically connected to the usets workstation and to also 
provide a means to view content liiat resides locally on the users wcokstation. 

The encoding processes used include independent compression of the Left and Right images. 
Independ^t conqoession of Left and Si^ provides better quality display output. A good exanqile of 
10 ttus is anaglyph method. The methods include a video setup format for compression (sbs format and 
asf). linage alignment reference points/indicators are used to aid in visual image alignment. Object 
viewers in stereo use multiple sub images for a one dimensianal or two-dimensional object viewer. 
The use of stereoscopic panning preserves the stereo image alignment. The co-existence of Java 
software and a plug-in solution minimizes downloadinglmage intetpolatian is used to generate in 
15 betwera stHBo views to minimize or maximize the stereo separation.Image interpolation is used for 
converting a ZD object movie to a 3D staeoscopic olgect movie. Also, the methods provide a 
background download c^ability. 

Several tools are used in the proems. ITiese include automatic stereoscopic alignment andAor 
le^alignment (rotational and shift and scale) and a stereo compression analysis tool to detect if the 
, 20 sbexco information is preserved after cotrnfuession. 

Stereoscopic jHeservation in a window during scrolling and window movement is very 
in^cfftant When interleaved stereo images are displayed in a window, the first line of the image must 
be on an even scan line, or else the image will be praceived in reverse stereo. The system looks at the 
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cumeat vertical location t)f1he window, and then places the first line of the steieo im^e on an even 
scan line. Whenever a user scrolls within Uiat wmdow, or moves the window itself, the application 
checks the odd/even status, and adjusts accordingly. In the case of vertically scrolling within a window 
or if the window itself is moved, the first line of the stereo iniage is placed on an even scan line. When 
5 the image is scrolled vertically, movesnent is done in even incienients so as to maintain stereo or the 
tight and left images ate swapped for each pixel move to maintaui steteo. For the case of horizontal 
scrollitig, the same methods as vertical scrolling apply. 

To display interleaved stereo images in a window or on a fulliscteen, the left and right fields or views 
must be preserved and presented consistently. For example the first horizontal line of a stereo image 

10 that is presented within a window may represent the right field or view and the seocad horizontal line 
the left field or view. In this exanq)le, the first horizontal line of the display device is even, or 
i^tresented by a zero, the right field/view is to be pssented on even scan lines, and the left field/view 
is to be presented on odd scan lines to maintain stereo. If the left field/view were presented on the even 
scan lines and the right field/view on the odd lines, then tiie result would be pseudostereo. The 

15 , selecticsi of associating the right field/view with even scan lines is arbitrary - the reverse can also be 
true provid&d consastency is maintamed. the left field/view may be on the odd scan lines, the ri^t 
fieldAdew on the even. 

The exemplary embodiment preserves left field/view and right field/view in a several ways. A 
first method is to sn^ the window to an even scan line, which ensures that the window starts on an 
20 even horizontal scan line. Another method is to look at the even/oddness of the first horizontal line 
where the stereo media starts. If the tight field/view is on the even scaa line, and the left field/view is 
on the odd, then no action is required, olfaecwise tiie left/right fields/views can be swapped - placing 
the left content on the even lines, and the ri^t content on odd, for every horizontal line in the media. 
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thaeby resulting in a storeo image. The ttnid-inetticsd is to shift the entiie viefwing region within the 
ydadcfw by one horizontal line to match right field/view with an even scan line and left field/view with 
an odd scan line. This may require dynamic lesazing of the window to accommodate the vertical shift. 
An algorithm looks at the cuuent vertical location of the window, and tfasi places the first line 

5 of the stexeo image on an even scan line. Whenever a user scioUs within that window, or moves the 
window itself, the application checks the odd/even status, and acgusts accordingly. In the case of 
vertically scrolling within a window or if the window itself is moved, the first line of the stereo image 
is placed on an even scan line. When the image is scrolled vertically, movement is done in even 
incremraits so as to maintain stereo. Steieo can be maintained by controlling the window position, 

10 fbrdng it to snap to even scan lines. The solutions include moving the window, moving the image, 
and swapping fields. 

Figure 2 illustrates the contents of a window displayed in stereo 100. A con^uter 102 and its 
monitor 104 are used to display a line interiaced stereo image 106 and 108. The stereo image is 
presented in a magnified form 110. This window could be a standalone application, plug-in, <x 
15 inteipieted program. The magnification shows the details of a Hne intedeaved stereo image. The even 
line of the stereo image is aligned with an even scan line of the monitoa:, which results in the display of 
a stereoscopic image. If the window moves, a check is done to determine even/odd scan-line, then the 
stereo image is started on an even scan line, ff the window is moved, it will sasp to start on an even 
scan line. 

20 Figure 3 illustrates the contents of window displayed in reverse stezeo 200. A CQnq)uter 202 and 

its monitor 204 are used to display pseudoscopic or reverse stereo image 206 and 208. The 

pseudoscopjc, or reverse stereo image is presented on the computer screen in a window. This window 
could be a standaloiK plication, plug-in, or interpreted program. The magnification 210 ^ows the 
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detaUs of a-lineinterieaved stereo image. The evega line of the stereo iinapis not aligned with an even 
scan line of the monitor, which results in the display of a pseadoscopic, or leveaise image. 

Figure 4 illustrates the contaits of a scrolling window displayed in stereo 300. A stereo image 
is presented on a computer screen in a window 302. This particular window scrolls vertically. The 
5 jSist line of the image is aligned on an even scan line 304 with the monitor, which allows for 
staiBoscopic presoatation. Whenever vertical scrolling occurs, even mcrements are made so lhat the 
image is always presented in stereo. 

Kgure 5 illustrates a G«ieral Software Howchart 400. Upcai start 402, the application checks to 
see wh^ fte image starts, on an even or odd scan line 404. if en an even scan line 406, a stereo image 
10 is ti^en displayed 408. If the image starts on an odd scan line 410, tbeai Hie image is shifted to an even 
scan line or the left and right field/views are swapped and then displayed 412. Vertical scrolling begins 
418 and is done by an even increment 420. 

To scale stKeo media, ttie left and right source must be preserved Since the format of flie 
original left and right is Imown, as designated by the tag within the Stereoscopic 3D Mb^ 
15 can be done while preserving stereo. An embodiment ooks at the storage method used, then takes the 
appropriate actions to scale the media while ]Heserving the stereo. Scaling may done to incre£^e or 
decrease the display size of the stereoscopic media. 

Figure 6 illustrates an analysis of the left and right media 500 that are extracted from the 
Stereoscopic 3D Media file 502, individually scaled504, 506, recombined mto the selected display 508, 
20 and then tiie resulting scaled Stereoscopic Media is dispbyed 510. 

To scale stereo media, the left and light source must be preserved. Since ihe format of the 
original left and right is known, as designated by the tag within the Stereoscopic 3D Media file, the 
scaling can be done while preserving stereo. The system will look at the storage method used, and then 
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taloe ibe sppcopda!to actions to scalerihe media while pFBserving the stereo. Scaling may "aone to 
iiiciease or decrease the display size of the steteoscopic media. 

Iri existing systems, stereo media can only be viewed at the original size. An embodiment 
provides a mechanism to increase or decrease the size at which the media is displayed while preserving 
5 the stereo. 

HgUie 7 illustrates that without any analysis 600, if the St^eosoopic 3D Media File is scaled 
without regard for flie format used for tihie left and ri^t, the scaled result will not be in stereo. 
Without any analysis, the Stereoscopic 3D Media jRiles 602 and 604 are scaled without regard for the 
format used for the left and right, the scaled result will not be m stereo 606. 

10 Moooscopic and Steteoscopic "Viewing allows greatea: distribution since both types can be 

viewed within one system. Prior Electronic Stereoscopic viewing systems only display stereoscopic 
media. The embodiments of tiie invention accommodate monoscopc and stereoscopic viewing. The 
embodiments of the invention allow users to access stereoscopic media without a 3D stereoscopic 
laiabled physical viewing device. This invention can have greater distribution and market pendration 

15 since it is not dqjendent upon a physical viewing (tevice. Ibis viewing system can be toggled to 
display mdnoscopic, as wdl as various stereoscopic modes (color anaglyjdi, gray anaglyph, line 
interleaved, page-flipinng, cross-eye, parallel viewing, etc.). 1h monoscopic mode, the image appears 
in 2D like otfier 2D web t»sed images which allows aU web users to view the images in 2D even if 
they do not have a stesreoscopic viewing device. 
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This is aoconipKshed by showing either flie left or-right mono image. The user can select 
whether to view the left or right monoscopic view. Users without a physical sljexeo viewing device can 
see the media in monoscopic form by selecting to use either tiie right or left monoscopic views. 

An embodiment of the invention contains automatic adjustment of Brightoess/Contrast/Image 

5 prc^erties adjustment based on viewing loechanism. No prior Electronic viewing system a<^usts media 
brigihtness/contrast based upon the display method. This embodiment adjusts the final display of the 
stereo media to accommodate LC shutter-glasses, and LC shutter-glasses with line-bianka: type 
products. When stereo media is viewed.through an LC shutter-glass viewing system it t^ears darker 
due to &e shuttering systeaxL Additionally when steieo ii»dia is viewed tiitou^ an LC Shutter-^ss 

10 coupled with a line blanloer, the media appears even daiker. This embodiment will adjust liie 
brightness, contrast and adaes media properties to compraisate for the color distortion/daiimess incurred 
by the viewing mechanism. Figure 8 illustrates the automatic adjustment of Brightness/Contrast/Image 
piopaties adjustment based on viewing mechanism 700. The Stereoscopic Media file 7Q2 is queried 
arid is displayed using shutter glassy 704. The Brightness a(^u6tmfint system 706 adjusts the 

15 brightness of the media file to accommodate the physical viewing mechanism 708. This same 
^bodiment can compensate for uneven image luminance between the left and ri^t eyes when using 
anaglyphic colored viewing glasses. 

Algorithms are used to reduce crosstalk between the left and right views. Other stereoscopic 
viewing systems do not incorporate a system to reduce crosstalk. Crosstalk often appears in stereo 

20 media and can be refened to as ^c^ting. Bright in one eye, dark in the other, occupying the same point 
in the scene can careate crosstalk. Areas of high contrast in stezeo media are subject to crosstalL This 
posting occurs because each eye is seeing some of the media intended only for the other eye, and in 
this case there may be very bright content in one eye, and darker content in the other eye. 

11 
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For exan^le,- the right eye could see fee media intended for the ri^t eye, buralso some of the 
media intended for the left eye. Seeing both at once tiirough one eye shows up as a fonn of ghosting. 
This invention locates points where crosstalk may occur, and adjusts the displayed stereo image to 
leduce or eliminate crosstalk. The sj^stem can query the hardware or the user to determine the 

5 optimum crosstalk reduction amount far a paitictilar viewing sysi^ 

Script butt(His (vxr scripts) axe used to change global steaeo formats. An embodiment of the 
invention provides a novel method to switch the cunoit display method for all stereo media currently 
displayed on-screen. For example, tea stereoscopic media files can be displayed on one web page. The 
display mode for each cf those files can be changed with one command. Once a steieo display method 

10 is selected, then each of the steieo windows is notified to switch to the newly selected format 
Typically, the usor would be lequiied to chastge the stereo display method for cash stereoscopic image 
ornaediafile. 

Using a script system, the viewing system is instracted to change display modes on the fly. The 
user can issue a comimand using a script to specify any viewing mode. All steaspscopic media files that 

IS are displayed on that web page are then dynamically switched to the new viewmg method Hgure 9 
illustrates a script command to set Ihe display mode to Color Anaglyph 900. The Web Page as 
recdved has media files as illustrated by Stereo Image Grey Anaglyph 904; Stereo Imagp Color 
Anaglyph 906; Stereo Image Cross-eye 908 and StaKO Image Parallel 910; Stereo Image Interleaved 
912; and Stereo Image Interleaved 914. With the Button: Set to Display mode to Color Anaglyph 916, 

20 fee Socipt Commands sets the Display Mode Color Ana^yph 918. Hie system converts all the media . 
files to Color Anaglyph as illustrated by files 920 througji 930. This embodiment is critical in 
providing an easy to use 3D stereoscopic viewing system. 

12 
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These is an enibodimeat tost saves and converts one fonnat into another fiom the Bitemet using ' 
a local drive from odginal source. The viewing system takes a Stereoscopic Media File, displays it on 
the user side according to the user's display preferences, and saves a local copy in whatever display 
fonnat the user selects. The system can convert the Stereoscopic Media into the display method 

5 selected by the user, and save the lesult on the user's local dtive. Alternately, ibe oii^nal form of the 
Stereoscopic 3D Media file may be saved on the user's local drive. This eanbodinK^t makes it possible 
to support special 3D formats that are not easy to generate in real time. 

A color calibration/adjustmi»it for physical 3D viewing n^hanisms, compensates for 
variations in the display devices. An embodiment includes the functionality to adjust stereo media 

10 jffoperties, thereby preserving the original color, hues, saturalioh, etc. when viewed Ihrou^ a physical 
viewing mechanism. For example, when looking ftrough Hqmd crystal shutter-^ass systems, the LC 
may introduce additional yeUow coloring to the subject matter. Based on the user's view settings that 
tell the originator what kind of viewing device the user may be u^g. Another embodiment of the 
invention corrects for distortions introduced by the viewing mechanism. Another example could be 

15 for anagjyidi viewing. For this example, the viewing system goes thiDU|^ a color calibration to attempt 
to more cl(»ely match the coloring of Hie anaglyph lenses with the coloring of the monitor or display 
device. 

A stereo media file format may contain certain sub media such as VBR and blocks. An 
embodiment supports a stereoscoinc media file tihat contains sub-media. Specifically, a file structure is 
20 created to store and preserve various types of stereo media in various foimats. Additionally, this file 
format can also store monoscopic media, as well as audio or other data. This one file foamat can store 
multiple or single stereo/non-stereo media elements. Kgure 10 illustrates a VRR file 1000 that may 
contain a script 1002, a Stereo Still Image 1004, a Stereoscopic Animation/movie 1006, Stereoscopic 
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Object Model-1008, a Hiumbnail 1010, and Audio 1012. This'eoflJDdjbBent also allows multiple 
resolution images to be stoiced in one media file or to be tefearenced (linked to) fiom one media file. 

The system may also include an automatic free view image size adjustment to mimmize 
viewing fatigue. For example, whai pataUel-viewing (also loiown as relaxed viewing, or ftee-viewing) 
5 stereo images, Ac separation of the left and ligjht should not greatly exceed the average intenscular 
distance of an adult 

Fi^e 11 illustrates a parallel viewing mode. For parallel viewing, it is important that the ri^t 
U04and left 1102 images be scaled and spaced so as to not exceed the viewer's eye spacing. If the 
viewer has a piismatlc viewing aid, the image separation can be increased. The users can be queded to 
10 detennine what viewing system is installed. Since most computo^ operating systems now store 
iiiforrnation on the width 1108 of tiie monitor image on the display monitor, it is possible to 
antomatically adjust the spacing and size of the right and left images to avoid eyestrain. 

Figure 12 illustratess a cross-eye viewing mode. For cross-eye viewing, it is possible to use 
15 larger images than with the parallel viewing method There is still a limit where many users wUl begin 
to experience eyestram. The user can be queried to detennine the limits of cioss-eye viewing. 

Auoth^ embodiment allows for automatic dejection of 3D display hardware. Many 3D 
stereoscopic hardware vendors install software that can be detected so that an appropriate display 
20 method can be automatically selected. If no stneoscopic hardware is detected, then Ihe system must 
pmmpt the user to configure the display nKxie. 
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Anothra embodiment automatically (or manually if desired) adjusts with overall left" and'nght 
image shift to compaisate for image magnificatirai. When a 3D stereoscopic image is enlarged and 
displayed on a viewing system tfiat has a larger image size then the tai^et system, tiiere is a potential of 
creating large separations l>etween objecte in the 3D stereoscopic image that can lead to eyestrain for 

5 the viewer. The present invoitioa stores impQctant parameters about the 3D stereoscopic imiage lite 
width, hei^ tar^ screen size, etc WIkd the 3D stereoscopic image is to be displayed on a displ^ 
that is larger or smaller than the target scroen size, then the 3D stereoscopic image is adjusted 
accordingly to minimize eye fatigue for tiie us^. 

One anbodiment utilizes imag^ processing to detect pseudo-stereo 3D stereoscopic content It 

10 is common for content authors to sometimes levecse the ngiht and left eyes when creating 3D 
stMBOsoopic content Whai this happens, the display system will present the wrong image to the 
viewer's eyes. This embodiment attempts to correct this problem by comparing portions of the right 
and left image content to detramine if a pseudo condition exists and then sw^ the right and left 
images to conect ficir the problem. 

15 ' 

Another embodiment encodes the ftiU-color left and right ima^ in sepai^ channels and 
conqiresses the left and right channels independently. This techniqae provides less compression 
artifacts and reduces crosstalk when compared to anaglyphic storage techniques. In comparison, 
analgypfa storage techniques, which are widdy used on the Litemet, combine tibe right and left images 
20 in separate color channels c£ a single image and then compressed the resulting image. This technique 
results in the introduction of cxosstalk because most compression techniques, like XFEG that is 
commonly used, reduce the color space of an image drastically, which in turn compromises the quality 
of the Anaglyphic storage technique. 
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< Anothra: embodiment allows video to be stored in a side-by-side format in a single video- 
streaming file. This encoding method allows the right and left channels to be independently 
compressed which provides the best qualily and eosores that the conect li^t and left image pair are 
matched \jp and that the images will not get out of syochioniz^on during a long streaming session. In 
contrast, if two separate stieamii]^ channels wexe used, extra pxocessing power would be required to 
manage two channels and ensure that they remained synchronized. Figure 14 illnstraEes the side-by- 
side fcmnat. The ri^t image 1400 is placed to the left of the left image 1402 to form the composite 
image 1404. The composite image is twice as wide as either the left or right source images. For 
inqnoved ccmpession quality when using some compression systems, a vertical colored separator 
band 1406 can be added between the right and left unage. Some compression systems work better with 
this sepsxattx band. 

Another embodiment of the display system is to create alignment dots or refiBrenoe imageis to 
15 help the viewer view cross-eyed or parallel view image formats. Figure 15 illustrates one method of 
displaying helper alignment images for a cross-eye viewmg mode. In this eicample, the helper images 
are placed bdow the imag^ 1504 and above the image 1506 and are aligned with the center of the right 
and left images. The helper images could also be shifted towards the edges of the right and left images. 
The images are of high contrast and attract the viewer to fuse the images first before the primary 3D 
20 straceoscopic image is viewed The simple high contrast nature of the alignment images allows them to 
be more eadly viewed. This system makes it possible for viewers with poor stexeo viewing capabilities 
to see more stereoscopic contrat with Ae cross-eyed, parallel, and other viewing modes. 

16 
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One Bndx>diinent-stx>res a sades of 3D stereoscopic images of an object intGrnug fQe. Hgure 16 
illustrates one way to store a series of N images into a single lesouice file. The first image 1600 is at 
the top of the file and the rest of the images follow sequentially until the last fQe 1602. The collection 
of these images fonns an object movie data file 1604. Figure 17 shows the relationship between the 

5 images and the object in question 1700. As the figure illustrates, the point of view of the camera is 
swung around the object to generate aii of the intermediate images. When these images are displayed 
in a sequential fashion, it appears that the object is. rotating on tibe screen in 3D depth. When the 
images are displayed in reverse order, the object appears to turn in the opposite direction. If the 
playback of the images is linked to the right/left movement of a mouse point on the screen, it will 

10 appear that the user is actually rotating the object on flie screen. This example illustrates a one 
dimensional object movie. It is possible to store additional seta of rotational images sets to simulate 
other views of the object (example: doors open or closed on a car model). 

Another embodiment allows a larger 3D stereoscopic image or panorama to be scrolled within a 
15 smaller viewing window as shown in Figure 18. The viewing wmdow 1802 is a fixed size and does 
not njove with respect to the viewing screen, the 3D stereoscopic image 1800 is larger than the 
viewing window and Ifaarefoce must be scrolled hodzontally and vertically within the viewing window 
in order for the viewer to see the entire image. This is always the case with panoramic images that 
contain a very wide ca: tall view of a scene. When the image is panned within the viewing window, the 
20 invention ensures that the left and ri^t views are presented to the ooirect eyes. For exanqtle, in the 
row interieaved viewing method, if the larger 3D stereoscopic image is moved verticaUy by a single 
pixel, the image will flip into pseudostereo mode. The present invention will either shift the image an 
additional Une to make it viewable in non-pseudosteieo or it will flip tiie left and right images to 
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correct the problem. This erabodimeiit is -an" extension of the previously described scrollirig 
ranbodimeDt since it applies the scrolling embodiments to an image that is scrolled within a viewing 
window as opposed to a viewing window which is scrolled on the display screen (as previously 
detailed). 

5 

Another embodiment allows the previously discussed display embodiments to be extended to a 
wider viewing audience on the Internet and for local viewing on a workstation by implementing the 
invention on multiple parallel systems. Rm: example, for vievwng 3D stereoaiopic content on the 
bitemet ihiou^ a biowsex, it is desirable to have uniform support for all browser systems. Th6 present 

10 invention providBS uniform support by impleiiKnting several parallel solutions, lii particular, Ifae 
jffesent invention can be implemented as a Netscape plug-in to support the Netscape browser (see 
www.netscape.C(om) or the present invention can be implemented as an Active-X control to support the 
Microsoft internet Explorer Browso: (see wwwJMicrosofLoom) or the present invention can be 
implemented as a Java Applet (see www.sun.oom) to suppot some other forms of browsers. The 

15 embodiment described here implements the present invention on all of these systems in parallel and 
utilizes browser client side scripting and/or server side scripting (well jbiown by someone skilled in 
web b^ed systems) to select the correct system for a particular user. When a user points their browser 
to a particular website page which contains 3D stereoscopic content, the system of the present 
inventicm will detenmne which parallel system to use. 

j20 

Anottier embodiment allows new n^t and left image views to be generated to simulate a new 
stereoscopic camera separation. Some viewers may find it hard to view some images if the original 
cameras were separated by a large amount. The current embodiment utilizes image interpolation and 
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mcqE*ing -techniques to synthesize a new right and left image tharatercloscT togetiier. The same 
technique can be used to simulate a wider stereoscopic camera separation to increase the depth eiEfect 
The amount of adjustment can be selected by the user to suit their viewing condition and capabilities. 
Figure 19 illustrates an original right 1902 and left 1904 cameitt views of an object 1900, The new 
5 synthesized right 1906 and left 1908 views will be easira: to view for some users. 

Another embodiment of the invention provides an automatic alignment and/or re-alignment of 
the left and right images. Many 3D stereoscopic images are created incorrectly and may have vralical, 
horizontal, or rotational misailignment that will cause eyestrain for the viewer. Using image correlation 
10 techniques, horizontal and vertical misaligrunent of the ri^t and left views is canected. Further 
conelation is applied to correct for rolBtional alignment issues. 

Another embodiment provides a tool that compaies tide left and right images to determine if 
stereoscopic information is lost daring compression. Conjpression is used to reduce die size of a 
IS stereoscopic image so that it can be easily transmitted over a low bandwidth connection. If too much 
compsssiOn is applied, the image will loose its stereoscopic impact This ooibodiment provides a 
measure of the quality of the stereoscopic image that can be used to readjust the compression system. 

Anoth^ embodimiODt allovrs both local content, residing on the users woricstation, and remote 
20 content, residing on a server or web site to be viewed using the display methods. Tbis mbodiment is 
needed to allow for remote streaming playback as well as to allow for local playback of files that are 
delivered via cd-rom or other storage means or for content that is downloaded from a remote location 
to a local storage location before being displayed, 
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Another embodiment of the present invention provides the ability to download larger sized 3D 
stereoscopic content files as a background task or during idle use times of the workstation as shown in 
Figure 13. These large sized files 1300 cannot be easily streamed over the Ititeinet in xeal-time or near 

5 real-time. Hus background downloading capability allows the pocesent invention to be more widely 
used on low-bandwidth systems. This embodiment utilizes a database of known locations where 
infonnation about 3D content is stored 1302, A subscription system or search engine can be used to 
access the 3D content or specific content can be added to the download database. The system of the 
present invention keeps track of what content has been downloaded in a second database 1304 and 

10 records details about the download that can be used to recover a faulty download. The 3D stereoscopic 
content is moved fi:om a remote location 1310 to a highor bandwidth local location 1308 where the 
content can be played back in real-time oar near real-time. The download database and the 3D 
stoceoscopic content location database are also used to help append 3D stereoscopic content into a 
larger local file. This method allows a very large or long content file to be broken into much smaller 

IS files that are downloaded one alter the other. As each file is downloaded, it is appended to the current 
local copy of tiie download. If new remote, content files are made available on a periodic basis, this 
system will allow them to be fended together as they become available. 

20 Another embodiment allows conventional 2D ' object movies, to be converted into 3D 

stereoscopic object movies. A conventional object movie utilizes a sequence of still images of an 
object captured a various view angles as iUustrated in Rgure 17. A 2D object movie can be converted 
to 3D stereoscopic format by paking up the original images. For emnple, in Figure 17, View 1 and 
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-A^ew 2 can be coinbined to fonn a left right pair (respectively). Hie next 3D stereoscopic view is 

fonned by combimng view 2 vtrith view 3 (left and ri^ respectively). Each image in the original 
object movie is used twice. If the original 2D object movie contains enough images (60 images 
produces good results) then the converted 3D object movie will be usable. If there are not enough 

5 images, less than 40, then better results are achieved if the previously mentioned ranbodimeiit of 
generating intennediate views using image interpolation can be applied to the object movie conversion^ 
Using image interpolation aUows intennediate stetec^copic views to be generated, which have much 
less camera separation and are easier to view. 

The present invention can also be embodied in the form of computer program code, for 
«uimple, whether stored in a storage medium, loaded into and/or executed by a computer, or 
transmitted over some transmission medium, such as over electrical wiring or cabling, through fiber 
optics, via electromagnetic radiation or via the Intemet, whemn, when the compute potogram code is 
loaded iato and executed by a CQn:piter, the computer becomes an apparatus for practicing the 
invention. When implemented on ai general-purpose microprocessor, the conqnitei' program code 
segments configure the micn^ffoceraor to create specific logic circuits. 

The modifications to tlie various aspects of the present invention described above are 
merely exeot^ary. It is understood that othra: modifications to the illustrative embodiments v?ill readily 
occur to persons with ordinary sldll in the art All such modifications and variations are deemed to be 
within the scope and spirit of the present invention as defined by the accompanying Claims. 
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CLAIMS 

Whatisclaiinedis: 

1 . A method for deKvering stereoscopic media in electronic fonn comprising: 
providing a single format with independent ri^t and left channels to represent the 

steasc^opic media; 

displaying said steieoscopic media inside a movable windowed area while eliminating 
pseudo strareo conditions daring movement; 

optimizing adjustments of parallax shift adjustment, brightness control, color 
adjustment, and cross-talk reduction of said steieoscopic media based cm viewing hardware, 
monitor size, and media comtent for optiinal viewing quality and 

seamlessly supporting for monosoopic (2D) viewing modes allowing deliveiy of said 
stereoscopic media in a nonnal 2D viewing mode. 

2. The method of claim 1. wherein said media includes images, videos, animations, and 

object models. 

3. The method of claim 2 whecdn delivering comprises locations including the Internet 
and electronic media. 

4. The method of claim 3 wherein electronic media comprises optical media and magnetic 
media. 

5. The method of claim 1 whemn a dngle media file format that is converted to various 
display formats on a user side. 

6. The method of claim 1 iiiither comprising a stereoscopic media in a window such as a 
browser or application. 
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7. The method of claim 1 fiirthercon^ffising steaeoscopic pxeservation in a window dniing 
scrolling and window movement 

8. The method of claim 1 comprising sapporting of auto-detection 3D stereo haidwaie 
systems. 

9. Hie method of daim 1 campiising sctipt buttons (VRR scdpts) for changing global 
stQ^eo formats. 

10. The method of claim 9 finrther comprising stereoscopic media SLt formats that contain 
sub media such as VSR and blocks. 

11. The method of claim loompdsing paialla^i shift adjustnaents based on a physical size of 
display window. 

12. The method of claim 1 further comprising automatic bd^toess adjostments. 

13. The method of claim 1 further compdsing color calibtation/adjustment£ for physical 3D 
viewing mechanisms, indudhig variations in display devices. 

14. The method of claim 1 fitrdier comprising crosstalk reduction techniques on a user side. 

15. The method of daim 1 fmlher comprising smart stereo scaling. 

16. The method of claim 1 further comprising integraticm of stereo media types into one 
viewer with script interaction. 

17. The method of claim 1 furliier COTopismg monosoopic and stereoscopic viewing that 
aUows greater distiibution since both types can be viewed within one system. 

18. The method of daim 1 comidsing saying and converting one format into another £Fom 
the Internet using a local drive from an odghml source. 

19. The method of claim 1 fnrtha: comprising automatic fnee view image size adjustment to 
minimize viewing fatigue. 
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20. The me&od of claim 1 furttied: composing pseudosterecr collection based on image 

processing of a few lines or the entire image. 

21. The method of claim 1 fmlhrar conjprising scaling said stereoscopic media, so that left 
and right sources are preserved, 

22. The method of claim 1 further oompiisitig improvements to Anaglyph display mefliods. 

23. A method for delivering stexeoscopic content in electronic fonn through Ifae internet or 
an intranet or similar network environment comprising: 

storing said stereoscopic content in a location that is not physically connected to a users 
wodcstation; and 

providing a means to view content tiiat resides locally on the users workstation! 

24. The melliod of claim 23 whereui the encoding processes used includes independent 
compression of Left and Rig^t images. 

25. The metiiod of claim 23 wherein Independent conpi^sion of Left and Sighit provides 
better quality display output 

26 . The method of claim 25 wherein said comi^sion uses an ana^yph method. 

27 . Hie method of claim 26 furtiier includes: 

a video setup foonat px compressioD (sbs facmat and asf). 

28. The method of claim 26 includes using image alignment rsference points/indicators to 
aid in visual image ali^mient 

29. The method of claim 28 including using multiple sub images by object viewers in stereo . 
for a one-dim^ional or two dimensional object viewer. 
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30. The method of- claini^9 including using stereoscopic panning that preseivetlirsteiBO 
image alignment. 31. The method of cljdm 30 uses a co-existence of Java software and a plug- 
in solution to mimmize downloading. 

32. The method of daim 31 using image inteqpolation to generalB in between stereo views 
to nununize or maximize the stereo separation 

33. , The method of claim 32 using ima^ interpolation ifor converting a 2D object movie to a 
3D stereoscopic object display and provide a background download c^ability. 
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